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A study based on student and faculty opinions is 
presented. It examines how well two types of preclinical curricula 
are preparing students to become competent physicians. Research 
questions include: how effective do students perceive their 
educational activities in two different preclinical curricula to be 
in helping them to pass their exams and become good physicians; how 
congruent are educational activities of preclinical students with 
student perceptions of activities leading to physician competence; 
and how congruent are the perceptions of students compared to those 
of their faculty. Preclinical students and faculty from a private 
midwestern American medical school participated. Responses were 
gathered from one class of traditional curriculum students and from 
one class of problem based learning students, students were asked to 
indicate how often in the past year they had used each of the 
different study resources listed for them and to rate a series of 
educational activities by their effectiveness in helping them pass an 
exam and for preparing them to become good physicians. Results 
indicate a greater congruence between the goals of medical school and 
the development of physician-like behaviors, such as professional or 
self-directed learning, in a problem based curriculum than in a 
traditional curriculum. Results from both tracks agree in that the 
most clinically oriented educational activities were selected by all 
students as being most effective in helping them to become competent 
physicians. Contains 5 references. (SM) 
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Medical educators have long recognized that medical schools 
cannot produce good physicians; rather schools provide the 
opportunity for learning about medicine to occur. The students 
themselves must learn medicine and the skills involved in 
becoming and remaining a competent physician. Only part of these 
competencies come from formal instruction (1). The GPEP report 
(2) affirmed that the overall goals of all of medical education 
are to enable students to acquire knowledge, skills, values and 
attitudes that all physicians should have and to develop the 
abilities to undertake responsibilities for patient care. A 
generic goal of medical education is to produce competent 
physicians who have the ability and desire to constantly improve 
their competence. The GPEP report (2) recognizes that self- 
directed learning behaviors are an integral part of physician 
competence and that medical schools should foster this behaviour. 
Adult educators (3) feel that competent professionals are among 
the most active self-directed learners. In fact this learning 
characteristic may help to distinguish competent professionals 
from less competent ones (3). The formal educational process 
should help students to develop the ability and desire to 
continue acquiring knowledge to aid in solving problems. To 
determine if medical school are achieving this goal, they must 
engage i n on-go i ng eva 1 uat i on . 
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One widely accepted model of evaluation is the determination 
of the congruence between performance and objectives, an idea 
first introduced by Tyler (4). Framed this way formative program 
eva 1 uat i on concerns determi n i ng the congruence between the 
program goal and how well the goals have been met. The goals of 
precl inical instruction are to begin developing physician 
competence and to prepare students for the clinical curriculum in 
the hope that the combination of these two types of curricula 
will develop good physicians. 

In this study we will examine how well two types of 
preclinical curricula (e.g., traditional and problem based) are 
preparing students to become competent physicians according to 
student and faculty opinions. The research questions addressed 
here u ~ 1 ■ jde : 

1. How effective do students perceive their 
educat i ona 1 act i v i t i es i n two d i f f eren t 
preclinical curricula for helping them to 
pass their exams and to become good 
physicians? 

2. How congruent are educational activities of 
precl inical students with student perceptions 
of activities leading to physician competence 
especially relating to professional learning 
abilities and clinical skills? 

2. How congruent are the perceptions of students 
compared to those of their faculty? 



0 

ERLC 



Methodol ogy 

Sample Precl inical students and their faculty from a 
private mid-western American medical school participated in this 
study. Responses were gathered from one class of traditional 
curriculum students and the same entering class of problem based 
learning students. The traditional curriculum involves mostly 
lectures and laboratories while the problem based curriculum i5 
composed of small group discussions of clinical cases with 
students studying material on their own. The same faculty are 
involved in both curricula. Students from both types of 
curricula were sampled at two time points: at the end of their 
first year and at the end of their second year, 62 (61%) of the 
first year, 46 (46%) of the second year traditional curriculum 
students and 17 (94%) first year, 9 (56%) second year problem 
based curriculum students responded, 

A representative sample of both classes responded at both 
time points, 42 (69%) faculty teaching in both curriculum, 
composed of physicians and basic scientists also completed a 
si mi lar questionnaire. 



O 0 

ERIC 



Instrument and analyses . The students completed the same 
questionnaire at the end of their first and second year^. First, 
•students were asked to indicate how often in the past year they 
had used each of the different study resources listed for them. 
Next, the students in each tracK were asked to rate a series of 
educational activities two ways: according to their effectiveness 
in helping to pass an exam and again for preparing them to become 
good physicians. The traditional curriculum students rated 13 
activities. The problem based curriculum students rated 12 of 
the same items plus five items relating directly to the problem 
based curriculum, (The one item from the traditional curriculum 
that the problem based students did not rank was a classroom 
activity that the problem based curriculum students -could not 
participate in.) The educational activities were chosen to 
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reflect the variety of learning activities appropriate for each 
curriculum. The problem based curriculum students rated the 
traditional curriculum activities because of a suspection by some 
of the faculty that these students were participating in 
traditional curriculum educational activities. For each item, 
the students rated how effective this activity was for both 
passing an exam and becoming a good physician u^ing a five point 
scale with 1 = not at a 1 1 effective, 3 = somewhat effective and 5 
= very effective. Analyses were kept separate by curricular 
track . 
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The faculty rated the educational activities from both the 
traditional curriculum and the problem based curriculum in terms 
of perceived effectiveness for passing an examination and for 
becoming a good physician in the same way that the students did. 

Mean usage scores by curriculum were computed for each study 
resource. F»~om the scores for each educational activity, two 
mean effectiveness scores were determined for the students cind 
the same two for the faculty. The txo mean effectiveness sc:res 
were for passing an exam and for becoming a good physician. The 
resulting mean scores then were ranked to facilitate comparisons 
between the two groups of students and the faculty and to look at 
the extremes of the lists. 

Resu 1 ts 

All of the tables give data from the end of the second year. 
The results are very similar for both years. Table i shows the 
mean scores, t test results for each item and ranks of the 
frequency of use of study resources. The students use study 
resources quite differently depending on their curriculum with 
resources little used in the problem based curriculum frequently 
used in the traditional track and vice versa. For example, co-op 
notes taken by the students of the traditional curriculum 
lectures and faculty generated syllabi of the traditional 
curriculum content are frequently used in the traditional 
curriculum, but rarely used in the problem based curriculum. 
Table 2 compares the educational activities in terms of their 
perceived effectiveness for passing examinations for the two 
prec 1 i n i ca 1 curricula. 
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Table 3 compares these activities in terms of* their pprceived 
effectiveness for becoming a good physician for students from 
both curricula. Both tables 2 and 3 show how dissimilar the 
groups of students are in the*r perceptions of effectiveness for 
passing examinations and how similar the two groups are in terms 
of thei r percept ions of effect iveness for becoming a good 
physician. (The two groups take different examinations.) Table 
4 lists the perceived most and least effective educational 
activities for the traditional curriculum students; table 5 does 
this for the problem based curriculum students. An * beside the 
item on tables 4 and 5 indicates that the faculty perceive this 
item similarly ( either most or least effective) based upon their 
ranked mean scores. * 

In the traditional curriculum only one activity, workshops, 
was seen as being most effective for both passing examinations 
and for becoming a good physician. These workshops were case 
discussions emphasizing pathophysiology content. 2/5 of the 
activities that were perceived by the traditional curriculum 
students as being most effective for becoming a good physician 
were seen as least effective of passing their exams. For 
example, although the traditional curriculum students recognized 
tnat they needed to read journals as physicians, they rarely used 
them as a study resource, probably because they were not 
effective to help them pass exams. The traditional curriculum 
activities were seen as least effective for the problem based 
curriculum students in terms of helping them pass exams or 
becoming a good physician. 



3/5 of the activities were perceived by the problem based 
curriculum students as both most effective for passing an exam 
and for becoming a good physician. These activities were 
textbooks, clinical skills sessions and problem solving sessions. 

The educat iona 1 act i v i t i es ranked as the most effect i ve for 
passing examinations in both tracks were also the most used study 
resources by students in that curriculum. The three most used 
study resources by the problem based curriculum students were 
also seen as the most effective in becoming a good physician. 
Only textbooks from the list of most used study resource in the 
traditional curriculum was seen as being very effective for 
helping to become a good physician. There was general agreement 
between the students and the faculty in terms of activities which 
are the most and the least effective for becoming a good 
physician. Faculty perceptions tended to agree with the 
traditional curriculum students in terms of what is most useful 
to pass their exams but also were seen as least useful to become 
a good physician. For the problem based curriculum, the faculty 
show agreement with the students in what is or is not useful to 
become a good physician, but shews less congruence with the 
students on activities which effect exam performance. The 
faculty felt that their own curricular materials such as the 
faculty developed objectives and suggested resource material as 
defined in the problem based curriculum guidebooks and faculty 
resource sessions were more helpful to pass an exam than the 
students did. 
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Faculty resource sessions were scheduled sessions in which 
students could ask faculty questions, faculty could go over 
difficult material or ask the students questions, 

D i scuss ion 

The same study was repeated with the next entering class. 
The results reported on in this study were generally replicated 
with the next cK ss. While the sample size is small in botn 
classes, the same results tends to show their reliability. 

Our results show a startling difference when comparing the 
two types of i nstruct i on/ 1 earn i ng , There is "little congruence 
between what the students in the traditional curriculum see as 
effective for passing exams when compared with becoming a good 
physician. By 'contrast the results from the problem based 
curriculum students are striking for the congruence between what 
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they see as effective in the short term for passing an exam and 
effective in the long term for becoming a good physician. The 
results from both tracks agree in that the most clinically 
oriented educational activities were selected by all students as 
being most effective in helping them to become competent 
phys i c ians , 

Since the two tracks exist in the same school, some faculty 
have felt that the problem based students may be using the 
traditional curriculum materials such as lectures and faculty 
developed syllabi instead of gathering the material on cheir own. 
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The results of tin's study show that the problem based students do 
not find the traditional curriculum materials helpful for either- 
passing examinations nor for becoming a good physician. Thus , 
they are not using them very much. 

The educational activities used most often by the students 
in the traditional curriculum and seen as most effective in 
passing their examinations encourage "student like activities 11 
such as taking direction on what and how to learn from the 
faculty. While good student behaviors, which include studying 
lecture notes (co-op notes), handouts made by the faculty 
(syllabi) and assignments from textbooks, often lead to student 
success, these same student strategies may not be effective 
strategies for becoming a competent physician. As the students 
recognize, physician achievement is rarely dependent upon faculty 
generated handouts, assignments or lectures. Therefore, students 
selected less "student- 1 i ke ff activities as most effective for 
becoming a good physician. 

While faculty and students in both tracks selected similar 
activities as effective for becoming a good physician, only 
students in the problem based track saw these activities as also 
effective for passing exams. These same activities were more 
used by the problem based students. Activities seen as more 

effective for becoming a good physician seem to us to be both 
more clinical in nature and more professionally relevant. 



learning skills, as defined oy r\now,es ana Gdgne/ ; *ucn .js 
iooKing up answers to p r ooi ems on rhei r own, consulting wrtn 
peers and more senior colleagues and reading journals. d>y thwir 
report, the problem oasea prec' inicai curriculum sruaents are 
engaged in more activities which he i p them to acquis some of me 
skiils required to become ana remain competent pnys.c 'dH, i : : 
would oe interesting to see how the students view tnese 
activities during their ci inicai years. 

While tnis study was on i y concerned with meaical stucents, 
tre same principles seem to appiy to other c i i n i ca • croryssicns. 
am of tnese professionals need to seek out information on t r ««i- 
own and to oe se i f-ai rect ed i earners. Other professions scnoo 1 c 
might cry to use some of the key e»ements of proo ! em basoci 
learning, such as small group < "scussions of Clinical case:-* v-nlch 
ieacls students to define tneir own learning needs arid to 
gathering information on their own, in order to foster mor~ 
professional learning behaviors in their studies. 

Conclusion and imp! icat ion . Med i ca i curricula s hou i a 
encourage physician-1 ike behaviour early, even aurinc rne 
preclinical years, if possible. These behaviors induce 
illustrating tne clinical relevance of basic science material, 
c~ el op i ng prob i em so I v ing ski i Is, I earn i ng acqu i s i t ion sk i i I s 
s-, :h as seeking out information on their own or consulting witn 
others, and continually improving and updating their Knowledge, 



If the goals of the prec 1 i n i ca 1 years are to lay the foundation 
for future practice, then preclinical curricula should be made to 
be more congruent with these goals. In addition to providing the 
students with a huge fund of basic science knowledge, preclinical 
curricula should foster the development of the phys i c ian- 1 i ke 
behav iors wh i ch will help to prepare them for c I i n i ca 1 work . 
The results of this study indicate that there seems to be a 
greater congruence between the goa.s of medical school and the 
development of physician like behaviors, such as professional or 
self-directed learning, in a problem based curriculum than in a 
tradi t iona 1 curr icul urn. 
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Table I Use of Study Resources from a list of 8 resources 

score 1 = never, 3 = sometimes, 5 = always. / rank 1 = most used 



Resource 

TC co-op notes 


TC 

mean 
4.26 


PBC 

mean 

1.56 


t test 
**** 


TC 

rank 

2 


PBC 

rank 

8 


textbooks 


3.35 


4.53 


** 


3 


1 


journals 


1.68 


3.23 


■it** 


8 


3 


TC syllabi 


4.82 


2.88 


*** 


1 


5 


Peers, faculty 2.86 
(informal discussions) 


3.35 


n.s. 


5 


2 


Audio visual 
materials 


2.90 


3.11 


n.s. 


4 


4 


TC = traditional 


curriculum 


PBC = 


problem based 


curriculum 





TABLE 2 



EFFECTIVENESS OF 


EDUCATIONAL 


ACTIVITIES TO 


PASS AN EXAM 






PBC 

MEAN SCORE 


RANK 


TC 


PC M INT 


Workshops 






4.111 


1 






Syl lab! 


2.222 


14 


3.822 


2 


Co-op notes 


1 .857 


16 


3. 773 


3 


Lectures 


1 .333 


1 7 


3.578 


4 


Labs 


2.888 


8 


3.289 


5 


Textbooks 


4.44 


l 
i 


O m LOO 


D 


C 1 i n i ca 1 skills 
sess i ons 


4 . 00 


2 


Cm m 7JO 


ft 
o 


StucJv arouDS 










Prob 1 em so 1 v i ng 
sess i ons 


3.333 


4 




-- 


Peer i nforma 1 
d i scuss ions 


3.22 

• Cm mm* 




C • OU? 


J 


Journa 1 s , art i c 1 es 


3.111 


6.5 


1 . 561 


1 3 


Computer exercises 


2.25 


i ^ 
i o 


9 Ann 


1 n 
1 u 


Learn i ng resource 
cent er 


3.000 


8 


3.05 


7 


Semi nars/1 arge group 
d 5 s c u s s i on <^ 


2.83 


10,5 


1 .837 


12 


Faculty informal 
di scuss ions 


3 1 1 




9 1 Pi q 


1 1 
1 1 


PBC guidel ines 


1 fifi<3 


1 R 






P3C learning issues 
notes 


2.444 


12 






PBC resouce sess ions 


2.833 


10.5 







Key 

rating scale - 1 = not at all effective s = very effective 
rank - 1 = most effective 
not rated by those students 
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TABLE 3 

EFFECTIVENESS OF EDUCATIONAL ACTIVITIES 
TO BECOME A GOOD PHYSICIAN 





PBC 




TC 




CATEGORY 


MEAN SCORE 


RANK 


MEAN SCORE 


RANK 


Workshops 


— 





4.333 


1 


C 1 i n i ca 1 sk i 1 1 s 
sess i ons 


4.44 


1 


4. 1 53 


2 


I nf orma 1 d i scuss i ons 
with peers 


3.33 


7 


3.619 


3 


Textbooks 


4.33 


2 


3.600 


4 


Jour na 1 s , art i c 1 es 


3 .666 


3.5 


3.464 


5 


Problem solving 
sess i ons 


3 .667 


3.5 






I nforma 1 d i scuss i ons 
with faculty 


3.55 


5 


3.308 


6 


Syllabi 


1 .777 - 


13 


2.933 


1 0 


Co-op notes 


1 .428 

4 


15 


2.523 


12 


Lectures 


1 .333 


16 


3.000 


9 


Labs 


3.222 


8 


3.267 


7 


Study groups 


3.50 


6 






Computer exerc i ses 


1 .1625 


17 


2.4000 


13 


Learning resource 
centre 


2.889 


9 


2.925 


1 1 


Sem i nars/ 1 arge group 
d i scuss i ons 


2.83 


1 1 


3. 194 


8 


PBC guidebooks 


1 .556 


14 






PBC learning issue 
notes 


2 .555 


12 






PBC resource 
sess ions 


2.885 


10 







Key 

Rating scale - 1= not at all effective s= very effective 
Rank 1= most effective 

O . Not rated by those students 




TABLE 4 

TRADITIONAL CURRICULUH END H2 

HOST AND LEAST EFFECTIVE EDUCATIONAL ACTIVITIES TO PASS AN EXAN 
AND TO BECOME A GOOD PHYSICIAN 



Host Effective to Pass Exam Hean Score Host Effective to Become Good Physician He an Score 



Workshops 
♦Syllabi 
•Co-op notes 




•Workshops 

•Clinical Skills Sessions 
Informal discussions w/peers 
Textbooks 

•Journals, Articles 



least Effective to Pass Exaih 
* JoufnaTsT^rt i c I es 
•Seminars 

Informal discussions with 
faculty 

Computer exercises 

/ 

Informal discussions with 
peers 



4.33 

4.15 

3.619 

3.60 

3.46 



Hean Score Least Effective to Become Good Physician Hean Scores 



•Computer Exercise 
•Co-op Notes 



2.10 •Syllabi 



•Learning resource center 
•Lectures 



2.40 
2.52 
2.93 

2.93 
3.00 



Key 
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• = Faculty rated this activity similary 

(i.e. falls into the same extreme category) 
I = Not at all Effective 5 = Very effective 

3/5 activities most effective for passing an exam are least effective 
for becoming a good physician. 

I - activity workshops seen as both most effective for passing 
exams and becoming a good physician 
2/5 - activities seen as most effective for becoming a good physician 
are seen as least effective passing exam 
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TABLE 5 

PROBLEH BASED CURRICULUH ENO H2 
HOST ANO LEAST EFFECTIVE EDUCATIONAL ACTIVITIES TO PASS AN EXAH 
AND TO BECOME A GOOD PHYSICIAN 



Host Effective to Pass Exam Hean Score Host Effective to Become Good Physician Hean Score 



Te^£^^ — ••Clinical Skills Sessions 4.44 

Clinical Skills Sessions "4.00 — ^Textbooks 4.33 

•Study Groups 3.50 •Journals 3.67 

Problem Solving Sessions 3.33 'Problem Solving Sessions 3.67 

Informal discussions w/Peers 3.22 Mnformal discussions w/Faculty 3.55 

least Effective to Pass Exam Hean Score Least Effective to 8ecome Good Physician Hean Score 

♦ 

/•Computer exercises 1.16 
Traditional curriculum lectures 1.33 

Co-op notes from Regular 1.86 *Co-op noi.es from traditional curriculum 1.428 

curriculum / 

PBC guidebooks _/_|.89 PBC guidebooks 1.56 

Syllabi from Regular 2.22 f Syiiabi from regular curriculum 1.77 

curriculum / 

•Computer exercises ' 2.25 



Key 

• = faulty rated this activity similarly 

(i.e. falls into the same extreme category) 

3/5 of the activities were seen as most effective for both 
passing an exam and for becoming a good physician. Problem 
based curriculum activities seen as relevant for becoming 
a good physician. Traditional Curriculum Activities are 
seen as not effective for either passing an exam nor for becoming 
a physician. 



